STAB-GCN: A Spatio-Temporal Attention-Based Graph Convolutional Network for Group Activity Recognition
نویسندگان
چکیده
Group activity recognition is a central theme in many domains, such as sports video analysis, CCTV surveillance, tactics, and social scenario understanding. However, there are still challenges embedding actors’ relations multi-person due to occlusion, movement, light. Current studies mainly focus on collective individual local features from the spatial temporal perspectives, which results inefficiency, low robustness, portability. To this end, Spatio-Temporal Attention-Based Graph Convolution Network (STAB-GCN) model proposed effectively embed deep complex between actors. Specifically, we leverage attention mechanism attentively explore spatio-temporal latent This approach captures contextual information improves group embedding. Then, feed actor relation graphs built videos into our STAB-GCN for further inference, selectively attends relevant while ignoring those irrelevant extraction task. We perform experiments three available datasets, acquiring better performance than state-of-the-art methods. The verify validity of highlight obstructive impacts attention-based graph recognition.
منابع مشابه
Attention-based Temporal Weighted Convolutional Neural Network for Action Recognition
Research in human action recognition has accelerated significantly since the introduction of powerful machine learning tools such as Convolutional Neural Networks (CNNs). However, effective and efficient methods for incorporation of temporal information into CNNs are still being actively explored in the recent literature. Motivated by the popular recurrent attention models in the research area ...
متن کاملEMG-based wrist gesture recognition using a convolutional neural network
Background: Deep learning has revolutionized artificial intelligence and has transformed many fields. It allows processing high-dimensional data (such as signals or images) without the need for feature engineering. The aim of this research is to develop a deep learning-based system to decode motor intent from electromyogram (EMG) signals. Methods: A myoelectric system based on convolutional ne...
متن کاملGated spatio and temporal convolutional neural network for activity recognition: towards gated multimodal deep learning
Human activity recognition requires both visual and temporal cues, making it challenging to integrate these important modalities. The usual schemes for integration are averaging and fixing the weights of both features for all samples. However, how much weight is needed for each sample and modality, is still an open question. A mixture of experts via a gating Convolutional Neural Network (CNN) i...
متن کاملSpatial Temporal Graph Convolutional Networks for Skeleton-Based Action Recognition
Dynamics of human body skeletons convey significant information for human action recognition. Conventional approaches for modeling skeletons usually rely on hand-crafted parts or traversal rules, thus resulting in limited expressive power and difficulties of generalization. In this work, we propose a novel model of dynamic skeletons called SpatialTemporal Graph Convolutional Networks (ST-GCN), ...
متن کاملSpatio-Temporal Graph Convolution for Skeleton Based Action Recognition
Variations of human body skeletons may be considered as dynamic graphs, which are generic data representation for numerous real-world applications. In this paper, we propose a spatio-temporal graph convolution (STGC) approach for assembling the successes of local convolutional filtering and sequence learning ability of autoregressive moving average. To encode dynamic graphs, the constructed mul...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Mathematics
سال: 2023
ISSN: ['2227-7390']
DOI: https://doi.org/10.3390/math11143074